Solution of reduced equations derived with singular perturbation 

methods 



Masatomo Iwasa 
Department of Physics, Nagoya University, 
Nagoya 464-8602, Japan 

(Dated: November 24, 2008) 

Abstract 

For singular perturbation problems in dynamical systems, various appropriate singular perturba- 
tion methods have been proposed to eliminate secular terms appearing in the naive expansion. For 
example, the method of multiple time scales, the normal form method, center manifold theory, the 
renormalization group method are well known. In this paper, it is shown that all of the solutions 
of the reduced equations constructed with those methods are exactly equal to sum of the most 
divergent secular terms appearing in the naive expansion. For the proof, a method to construct a 
perturbation solution which differs from the conventional one is presented, where we make use of 
the theory of Lie symmetry group. 
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I. INTRODUCTION 



This paper investigates perturbation analysis of the fundamental system of nonlinear 
ordinary differential equations, 



— ■=u = Mu + efiu) 
at 



(1) 



where m G C" is the dependent variable, M is a constant n x n matrix, / : C" — > C" is 
nonlinear function of u, and e G M is a perturbation parameter. In what follows, we refer 
to u = Mu as the unperturbed system and ([1]) as the perturbed system. The simplest 
perturbation solution is the naive expansion. Let us pose an expansion for the solution in 
powers of £, 



u 



(t;£) = ^eV^)(t). 

p=0 



(2) 



If we substitute Eq. ([2]) into Eq. ([T]), expand the both side of the equation with respect 
to e and equate the coefficients of each power of e, then we obtain the following series of 
differential equations: 



u(^) = Mm(p) + for p = l,2, 



(3) 



where 



^(0) (1) ... ,» 



(4) 



If we solve these equations recursively, we find the naive expansion. 

In this paper, we are especially interested in singular perturbation problems where secular 
terms arise in the naive expansion. In general, if f{u) is a power series, secular terms 
arise in the naive expansion as we see later. To eliminate those secular terms, various 
appropriate methods are developed such as, for exarnple, the renormalization group method 




the method of multiple time scales 



theory [8|, the averaging methods 



7|], canonical E 



^, the method of normal forms {?], center manifold theory 



amiltonian perturbation 



10l |. and so on. We refer to these methods simply as singular perturbation methods in this 
paper. It is well known that all of these methods result in equations all of which are 
equivalent that govern the long-time behavior of the system. Each of them is the dynamics 
for integral constants of unperturbed system, or in other words, dynamics in the null space 
of the linear operator determined from the unperturbed system. Although the name of that 
equation such as the renormalization group equation or the normal form depends on the 
method, in this paper, we refer to it simply as reduced equation. 

There have been many studies which show those singular perturbation methods surely 
lead to the well-behaving approximate solution. However, what the solution of that reduced 
equation exactly includes has not been clear. In the paper, we reveal the exact solution of 
the reduced equation. To be precise, the following statement is the main result shown in 
this paper. 

Main result : the solution of the reduced equation up to first order for singular perturbation 
problem (QP is equal to sum of those terms which are proportional to et, e^t^, e^t^^ . . . in the 
naive expansion . 

In what follows, we refer to those secular terms as most divergent terms in the naive expan- 
sion. Although this fact has been believed to be true in some cases jllj], this is rigorously 
proved in this paper. 

In the proof of the result, we first present another method to construct a perturbation 
solution, that is in Proposition 1 in section II. While Z^^-* in Eqs. ([3]) must be more compli- 
cated function of u^^'^ , "u*^^^ , • • • , u^^'^ as p becomes large in general, the method presented in 
section II leads to another recursive equations which has clearer expression compared with 
the Eqs. ([3]). In the derivation of those recursive equations, we make use of Lie symmetry 
group which leaves the system Eq. ([1]) invariant. This method can be interpreted as a 
extension of the renormalization group method with Lie symmetry group [6] . The recursive 
equation plays an important role in section III for the proof of the main result. 
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II. A METHOD TO CONSTRUCT A PERTURBATION SOLUTION 



Consider the system of nonlinear ordinary differential equations as follows: 

— :=u = Mu + ef{u), (5) 

where u = u{t) G C" is a vector valued function of an independent valuable, M is an n x n 
matrix whose all coefficients are constant, e is a constant and / : C" ^ C" is a smooth 
vector valued function. In what follows, we refer to ii = Mu as the unperturbed system and 
(j5]) as the perturbed system, and the solution of the system ([5]) is denoted hy u = u{t; e) for 
the dependence to the perturbation parameter e. 

Firstly let us find a method to construcl^a perturbation solution. For the construction, 
we make use of the Lie symmetry method jl2|. 

Proposition. 1 Suppose il){t,u;e) G C" a vector valued function oft, u and e, and 
its formal expansion in powers of e, tlj{t,u]e) =: YlT=o ^"^ ^ ''A ^ admitted. Then, for 
ip{t, u] e) which satisfies the recursive differential equations, 

L^W = /, 

L^W = ^(-1) -dj-f- dui^^'-^^ for r = 1, 2, 3, . . . , (6) 
L := I{dt + {Mu)-du)-M, 

the solution of system ^ satisfies, 

u{t-e) = u{t;0) + J2 / a>(")(t,n(t;a))cia. (7) 

Here I in the definition of L denotes the identity matrix. 

Proof. Suppose Eq. ([5]) admits a Lie symmetry group whose infinitesimal generator is 
denoted by 

X ■.= d, + ^{t,u;e)-du. (8) 

Then its prolongation X*, 

X* = d, + ^{t,u;e)-d^ + r{t,u,u;e)-d^, (9) 
i)''{t,u,u]e) := [dt + ii- du]ilj{t,u]e), 



satisfies the infinitesimal criterion of invariance of system ([5]), tliat is 

X*[u-Mu-ef{u)]\^^^ = 0. (10) 

Eq. ([TO]) reads 

[I{dt + (Mu) ■d^)ij-Mij-f] + £[f-duil^-^- duf] = 0. (11) 
For tlie formal expansion in powers of e, 

^(t,zx;£) = 5^£^V'^'-)(t,w), (12) 

r=0 

by substituting Eq. f[T^ into Eq. (ITT]) and equating the coefficient of each e^, we find 
recursive equations as follows: 

L^W = /, (13) 



(r) 



\pir-i).dj_f.d^^ir-i)]^ for r = 1,2,..., (14) 



L ■= I {dt + (Mu) ■ du) - M. 

Solving Eq. (fT3l) and Eq. (fT^ recursively, we obtain formal expansion of the infinitesimal 
generator of a Lie symmetry group which leaves system ([5]) invariant. Then the solution of 
system dSD, ^ = u{t]e), invariant to X satisfies 

X[u-«(t;.)]|_(,^^) = 0. (15) 

Eq. ( |T5i) reads 

d 

— = ^p{t,u{t;e);e) (16) 

oo „e 

^u{t;e) = M(t;0) + V / a''ij^''\t,u{t; a))da. (17) 

Thus, the integral equation (JTj) for the solution of system ([5]) has been obtained. □ 

It should be remarked here that it is not necessary for e to be small in this proposition. 
Therefore, Eq. (fT6l) holds not only for perturbed systems but also for generic systems which 
take the form of Eq. ([5]) although it seems to be practical for perturbation problems. 



III. THE SOLUTION OF REDUCED EQUATIONS 



Next, consider those systems whose hnear part can be diagonahzed. Then the system ([5]) 
reads 

z = Kz + eg{z), z G C", (18) 

with a hnear transformation from u into z. Here A is an t?, x n diagonal matrix whose 
components are denoted by Ajj =: 5ijAj, and g is the nonhnear vector valued function 
constructed from / with the transformation. Then the recursive equations corresponding to 
Eqs. ^ become 

n 

L^4^ = Y.[4~'^9^.9^-9AA-'^] for r = 1,2,..., (19) 

\ k=l / 

for a vector valued function, (f){t,z]e) G C" for r = 0,1,.... Here and in what follows, 
the components of vectors and matrices are explicitly denoted for the clarification of the 
following discussion, and equations hold for i = 1, . . . ,n. In the same way we have derived 
Eq. ([7]), it follows that the solution of Eq. f|T8l) . z = z{t; e), satisfies 

z^{t;e) = z,{t;0) + J2 s''4\t, z{t; e))d€. (20) 
r=0 ^0 

As we see later, if we obtain {<j)^^\t, z)}, we can construct the naive expansion using Eq. fl20p 
with iterative method since we know the solution of the unperturbed system, z{t] 0) = e^^zo 
where zq is a constant. 

Now we can show the following proposition. 

Proposition. 2 Suppose the nonlinear function in Eq. [T8\) is power series such as 

oo n 

9^i^)= E c'^p.-.p^n^''' (21) 

Pl,P2,---,Pn=0 fe = l 

where each C^^p^ Pn ^'^ constant. Then there is a solution of Eqs. [W\) which becomes power 
series of t and z which satisfies ^j-^'* = 0{f) for r = 1, 2, . . . while (pf^ = 0{t). 



Proof. Firstly, we seek (f)^^\ According to Eqs. (1191) . it is the solution of the differential 
equation, 

oo n 

u^\t,z)= c;^P2...p.U'l'- (22) 

pi,P2,---,Pn=0 k = l 

Note that, for arbitrary {pi, p2, ... ,Pn) G N", 11^=1 ^k" eigenfunctions of Li. Among 
inhomogeneous terms in the right hand side, those which satisfy the resonance condition, 
Yl^=i ^jPj ^ = 0) cause secular terms in the solution. Then we obtain, 

n n 

4^\t,z)= Y. c'i.«..,..'n4'+ E n^^^ (23) 

j=i ^i=i "^jPj 

pi,P2,...,Pn pi,P2,---,Pn 

E"=i A,P, - A, = E"=i ^jPj - A, ^ 

Next, we seek According to Eqs. (fTOl) . it is the solution of the differential equation, 

n 

L^<^^'' = J2[^f^^.9^-9A.c|^f^]■ (24) 

j=0 

By virtue of the inhomogeneous terms in Eq. can be split into four parts as 



[r.h.s. of Eq.dSl] = J] # + E ^kp2...pJ U 

i=i j=i 

pi,P2,.--,Pn pi,p2,.--,Pn 

E"=i AjP, - A, = E"=i A,P, - A,: ^ 
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n 



pi,P2,...,Pn p\,P2, ■ ■ ■ ,Pn 

E"=l A,P, - A, = E"=i A,P, - A, ^ 

for some constants {E^^^^ ^pip2...p„^ P2---Pn ' pip2 ■ ■ -Pri^ ' "^^^ tcmis lu the first part 
seem to cause secular terms in ^'^^-^ which are proportional to since each of them satisfies 
resonance condition. However, we can show the first part vanishes by substituting Eq. 
( !2T|) and Eq. (!23|) into the right hand side of Eq. fl24|) and calculating {Ep^^^ p^}. The 
calculation is found in Appendix A concretely. Therefore, the most divergent terms in cj)'^^^ 
are not proportional to but proportional to t. For r = 2, 3, . . ., inhomogeneous terms in 
Eq. (fT9|) which are proportional to and which satisfy the resonance condition remain in 
general. Then those inhomogeneous terms cause secular terms proportional to f in (/)*^^'\ □ 



Now we can find the solution of reduced equations wfiicfi result from various singular 
perturbation methods. 

Corollary. For the system of differential equations, 

dz{t] e) 



t<j>m^{t;e)), (26) 

with z{t; 0) denoting the solution of the unperturbed system, the solution is equal to sum of 
terms proportional to et, e^t^, . . . , e^t^, . . . in the naive expansion of system [T^) . Here 
is split into 0^°''(t, z) =: t(j)fec{z) + (j)non{z) by virtue of Eq. [23^. 
Proof. According to Eq. ( l20l) . 



z{t;e) = z(t-Q) + / t<PfJMt;(^))da+ cPlZi^{t; a))da 







e 



+ / ecp^^^ (t, z{t; a))da + / e^cj)^'^^ (t, z{t- a))da + ■ ■ ■ . (27) 
Jo Jo 

Thanks to this self-consistent integral equation, we can construct the naive expansion 
with iterative method. In terms of Proposition 2, it follows that terms proportional to 
et, £^t^, . . . , e^t", ... in the naive expansion arise only from the term t(f)fec{t] a)da among 
terms in the right hand side of Eq. (!27l) any step of the iteration. Therefore, the so- 
lution of the following equation fl29l) is exactly equal to sum of terms proportional to 
et, eH'^, . . . , ... in the naive expansion; 

z{t; e) = z{t; 0) + t0i°2(^(t; a))da, (28) 
Jo 

^^^ = t<Pm^{t;e)), (29) 

where we adopt the solution of the unperturbed system as z{t, 0). □ 

To complete the proof of the main result, we have to show various the widely-accepted 
reduced equations is equivalent to Eq. fl26|) . As a result of singular perturbation methods, 
we obtain reduced equations such as 

^^ = ezi'Mt;e)), (30) 

where z^^^ denotes the coefficient of e in the naive expansion and we set z^^\t,z^^^) =: 
Znon ( Z ^^'). Eq. (I30l) is a normal form expression of the reduced equations. 
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Although the well-known normal form contains linear part [Tf such as 

dz{t; e) 



A5(t;£) + £0(°)(5(t;e)), (31) 



dt 

Eq. fl3T]) reads Eq. fl32|) under 2; := exp {—At)z. We can transform Eq. fl32!) into renormal- 
ization group equation or equivalent reduced equations derived with other methods if we 
adopt integral constants appearing in the solution of the unperturbed system as dependent 
variables The equivalence of the normal form theory and the renormalization group 



method is discussed in [l3| in detail. 
Eq. ([30D reads 

dz{t; e) 



e4>fMt:e)) (32) 



dt 

for the following reason: For the expanded form of the solution, z{t] e) =: S^Q£^z'^^^(t), z^^^ 
satisfies 

zf\t) = \z!^\t) + g,{z^'\t)) 



dt + Y, (0) zf\t, z^'y) = \zf\t, z^'y) + g,{z^^) 

k=l / 

^\^dt + J2 ^kz^d^io, - zl'\t, zW) = g,{z^'^). (33) 

Eq. (1331) corresponds to the first equation of ( fT9l) if we replace z^^^ and z^'^^ to 0'-°^ and z 
respectively. With a new independent valuable r := et, both Eq. fl2^ and Eq. fl5^ can be 
written as 

^ = 0i°i(^(r)). (34) 

Thus, we have shown that the solution of the reduced equations is equal to sum of the most 
divergent terms in the naive expansion when we construct the reduced equations up to only 
first order. 
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IV. EXAMPLE: THE DUFFING EQUATION 

Let us see what is shown above holds through a simple example. Consider the Duffing 
equation, 



il + u = 6U 



Introducing z := u + iii for simplicity, we have 



1 / -X 

z + iz = e-{z + z) 



(35) 



(36) 



Firstly, let us review the proof of the main result with this example. Suppose Eq. fl36|) 
admits the Lie symmetry group whose infinitesimal generator is denoted by 



X :=de + ip'{t, z, z; e)d, + i)^{t, z, z] e)dz 



Note that it can be shown tjj^it, z, z\ e) = ijj^{t, z, z; e). Then its prolongation X*, 



X* 



i)\t,z,z,z/z]e) 



de + ilj''{t, z, z\ e)d^ + i)\t, z, z\ e)d2 
+^/'^(t, z, z, i, z] e)di + i)^{t, z, z, i, z\ e)d^ 



^~^{t,z,z,z,z\ 5), 



satisfies the infinitesimal criterion of the invariance corresponding to Eq (fTOl) . 



X* 



z + iz — e-{z + z) 
8 



0. 



Eq. 



For the formal expanded form of ifj 

00 

^^(t,^,z;£) = J]e^^M(t,z,z), 



r=0 



the equation for the leading order becomes 



{dt — izdz + izdz + i)il)^^\t, z,z) = -{z + z) 



(37) 



(38) 



(39) 



(40) 



(41) 
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Solving this, we obtain 

ib'^^Ht, z, z) = — -z^ + —tlzl^z + —\z\z + —z^. 
^ ^ ' ' ^ 16 8 ' ' 16' ' 32 

The reduced equation corresponding to Eq. fl26|) becomes 

dz{t,e) 3i 



(42) 



de 



-t\z{t;e)\^z{t; e). 



(43) 



With the the integral equation expression corresponding to (!28|) . we can find the solution 
with iterative method. The solution up to third order becomes 

z(t, e) = Ae~'' + -et\A\^Ae-'' - —£H^\A\''Ae-'' - -^eH^lAfAe-'' + ■ ■ ■ , (44) 
V , ; g I I 128 ' ' 1024 ' ' > v ; 

where A denotes the integral constant. We can immediately show this solution is exactly 
equal to the most divergent terms in the naive expansion by constructing it directly. 

Next, let us see Eq. P3|) is equivalent to reduced equations derived with the conventional 



singular perturbation methods. Although there are many ways to represent the reduced 



equations, one of them is the normal form 

dz{t) 



3i 



dt 



-iz{t) + e—\z{t)\^z{t), 



(45) 



which corresponds to ( 13T1) . Under z =: A{t)e Eq. ( H5l) reads 

^ = e||A(t)|M(t). 



(46) 



which corresponds to ( l30l) . If we set A{t) =: R{t)e '"^^^ where R{t), 9{t) G M, the reduced 
equation reads 



dR 

dt 8 



(47) 
(48) 



which is called renormalization group equation 
Eq. die]) read 



2|. Under t := et, both of Eq. (HHl) and 



dzjr) 
dr 



3i 



— Z{T Z[T . 



(49) 



Thus, the equivalence has been shown for the Duffing equation 
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V. CONCLUDING REMARKS 



The main purpose of this paper has been the derivation of the exact solution of the reduced 
equations which result from singular perturbation methods. What has been shown is that 
the solution of the reduced equations up to first order is equal to sum of the most divergent 
terms, which are proportional to et, e'^t'^, e^t^, . . . appearing in the naive expansion. In other 
words, taking up to only first order with respect to perturbation parameter is enough to 
include those most divergent terms in the approximate solution. The main result has been 
proved without any approximation. Then it holds not only in the case e is small, although 
this result is meaningful in the context of the perturbation analysis. 

Another result has been presented in this paper. That is a method to construct a per- 
turbation solution where we make use of the Lie symmetry group which leaves the system 
invariant. With this method, we obtain recursive equations ([6]) instead of Eqs. ([3]). 

For the future, it should be investigated that how the approximation improves if higher 
order terms taken into consideration when we construct the reduced equation. Another 
interest is the application to systems of partial differential equations (PDE). In some PDE 
systems, it has been shown that, in constructing reduced equations, we should take up 
not only most divergent terms in the naive expansion but also other terms to preserve the 



symmetry of the original system 



14l |. Therefore, the proof presented in this paper should 



be modified properly to those systems. 
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APPENDIX A: THE CALCULATION OF E^^p^ IN EQ. (f25]> 



At first, we consider the first term in the right hand side of Eq. (p^ . (pj'^dz^g^- Sub- 
stituting Eq. (!?!]) and Eq. (125]) into Eq. (1211) . and writing terms proportional to t, we 
obtain 

/ \ 



'^PlP2...Pn^ll 



k=l 



Pl,P2,--.,Pn 

V E^=i AfePfc - A, = / 

+ [terms not proportional to t]. 



\qi,q2,---,qn 



k=l 



(Al) 



Those terms which are zero eigenf unctions of Ylt=o ^kZkdz^. — Aj cause terms proportional to 
t"^ in (f)f'\ Such terms in the right hand side satisfies the resonance condition: 



h{Pk + Qk) + \j{Pj + {qj - 1)) - Ai = 0, 



(A2) 



k = l 



which reads 



XkQk - Xi = 



(A3) 



k=l 



since Ylk=i ^kPk — Aj = 0. Then, the resonant terms which is proportional to t in the right 
hand side of Eq. (lAip become 

/ \ / \ 



pi,P2, ■ • -,^71 

\ Efc=i KPk - A, = 



k=l 



dz 



qi,q2, ■■■ ,qn 
\ Efc=i Afc^fc - A, = 



k=l 



(A4) 



On the other hand, for the second term in the right hand side of Eq. ( l25l) . g^dzj<f>f'\ 



( 



= E CU..q.U4']d. 



\qi,q2,--;<ln 



k=l 



Pl,P2, • • . ,Pn 



k=l 



+ [terms not proportional to t] 



(A5) 
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The resonance condition in this case becomes 

n 

^ ^k{Pk + Qk) + \{{Pj - 1) + Qj) - Ai = 0, 



(A6) 



k = l 



which reads 



^kQk — — 0, 



(A7) 



k=l 



since Yl^=i ^kPk — Aj = 0. Then, the resonant terms which is proportional to t in the right 
hand side of Eq. (lASp become 



\ EI?=i Afc9fc - A, = 



fc=l 



k=l 



Pl,P2, ■■■ ,Pn 

\ 5Dfe=i AfcPfc — Ai = 



(A8) 



/ 



This is equal to Eq. (]A4p . Thus, it is shown that resonant terms which is proportional to 
t in d^^^dz-Qi — Qjdz df'^ for all ?' and i is equal to zero. That is to say, all of {Et^^^ „ I i^i 

J 3 3 '' ^ /-'l/'2 ■ • '* 

Eq. fl2Sl) is equal to zero. 



REFERENCES 

[1] L. Y. Chen, N. Goldenfeld and Y. Oono Phys. Rev. E54 376, (1996) 

[2] S. Goto, Y. Masutomi and K. Nozaki Progress of Theoretical Physics 102 471, (1999) 

[3] H. Chiba J. Appl. Dyn. Syst. 7 895, (2008) 

[4] H. Chiba J. Diff. Edu. (2008) (in press) 

[5] H. Chiba J. Math. Phys. (2008) (in press) 

[6] M. Iwasa and K. Nozaki Progress of Theoretical Physics 116 605, (2006) 

[7] A. H. Nayfeh Method of Normal Forms (John Wiley & Sons, INC.), (1993) 

[8] G. Hori Puhl. Astron. Soc. Japan 18 287, (1966) 

14 



[9] N. N. Bogolyubov and C. M. Place Asymptotic Methods in the theory of nonlinear oscillations 

(Gordon and Break), (1961) 
[10] J. Guckenheimer and P. Holmes Nonlinear Oscillations, Dynamical Systems, and Bifurcations 

of Vector Fields (Springer- Verlag New York), (1983) 
[11] N. Goldenfeld Lectures on phase transitions and the renormalization group ( Addison- Wesley) , 

p. 523 (1992) 

[12] P. J. Olver Applications of Lie Groups to Differential Equations (Springer- Verlag New York), 
(1986) 

[13] L. R. E DeVille, A. Harkin, M. Holzer, K. Josic and T. J. Kaper Physica D (preprint) 
[14] R. Graham Phys. Rev. Lett. 76 2185, (1996) 



15 



